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Developers of cancer immunotherapy have struggled for 
decades to achieve clinical success in using the patient's 
immune system to treat cancer. In the absence of a defined 
development paradigm for immunotherapies, conventional 
criteria established for chemotherapy were applied to these 
agents. This article summarizes the recent lessons for deve- 
lopment of agents in the immunotherapy space, describes the 
systematic creation of a new clinical development paradigm 
for cancer immunotherapies and integrates this paradigm 
with the emerging methodological framework for a new 
clinical sub-specialty of immuno-oncology, which was driven 
by the collaborative work between the Cancer Immuno- 
therapy Consortium (CIC) of the Cancer Research Institute in 
the US and the Association for Cancer Immunotherapy (CIMT) 
in Europe. This new framework provides a better defined 
development path and a foundation for more reproducible 
success of future therapies. 



Background 

Immunotherapy of cancer has a history full of important 
discoveries that goes back to the late nineteenth century, when 
William B. Coley observed tumor regressions following the 
injection of a bacterial broth also known as Coley's toxins into 
malignant lesions. This was followed by a series of discoveries but 
also draw-backs that have led to marked fluctuations in attitude 
toward cancer immunotherapy. 1 ' 2 Until recently, this field has not 
systematically assessed and integrated the available knowledge on 
the unique aspects of immune therapeutic approaches to establish 
a methodological framework for rational clinical development that 
enables reproducible clinical success. 3,4 Such reproducible success 
is needed for the cancer immunotherapy field to improve the 
perception among stakeholders and rise as a recognized sub- 
specialty within oncology and human medicine. 

Cancer immunotherapies, ranging from monoclonal antibodies 
to complex cellular vaccines, have long been considered as 
promising, and are expected to provide clinical benefit with 
focused or minimal toxicities. The fact that they have not yet 
delivered on that promise may be due to the incomplete scientific 
understanding of tumor immunology on one hand and the use of 
conventional development plans as defined for the distinctly 
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different but more familiar chemotherapeutic agents on the other 
hand. Thus, some immunotherapy failures can probably be 
explained by their lack of efficacy, while others may be due to an 
inadequate approach to their development. Recently, Goldman 
and DeFrancesco pointed out that some reasons for develop- 
mental failures include "companies not doing their homework" 
and asked "what lessons from the list of failures will inform future 
practitioners in the field?" 3 

Such lessons are now available after having been systematically 
defined over the past decade with the aim to improve the 
developmental path and enable success in the cancer immuno- 
therapy space. 4 ' 6 Driven by the struggle of biotechnology 
companies and academic institutions devoted to immunothera- 
pies, the Cancer Immunotherapy Consortium [CIC; formerly 
Cancer Vaccine Consortium, a program of the non-profit 
Cancer Research Institute (CRI)], which was founded for the 
advancement of the cancer immunotherapy field, began to create 
a systematic framework that would provide the knowledge and 
tools needed for their successful development. CIC formed a 
partnership with the Association for Cancer Immunotherapy 
(CIMT) in Europe, and, with broad contributions from the 
scientific and drug development communities developed the 
new framework that encompasses the following: a development 
paradigm for cancer immunotherapies, harmonized use of 
methods for measuring immune response as a foundation for 
immune biomarker development, 7,8 improved study designs 5 and 
clinical endpoints, 9,10 a publication framework for immune 
monitoring results from clinical trials, 11,12 and scientific exchange 
and regulatory interactions to inform guidance document 
development by regulatory authorities. 13,14 

In the last three years the field - for the first time — saw the 
clinical proof of success for cancer immunotherapies achieved in 
controlled randomized Phase III trials meeting primary survival 
endpoints: the first regulatory approvals of a therapeutic cancer 
vaccine, sipuleucel-T (Provenge 111 ) for hormone-refractory pro- 
state cancer, 15 and for the T-cell potentiating monoclonal 
antibody anti-CTLA-4 (ipilimumab; Yervoy). 16 ' 17 With these 
historic milestones reached in two unrelated tumor entities and 
two distinct agents, immunotherapy is finding entry to the 
landscape of prescription medicines in oncology next to the 
existing approaches of chemotherapy, small molecule targeted 
therapies, radiation and surgery. The clinical development paths 
of both agents have contributed to define and to demonstrate the 
practical value of the new development paradigm. 4 

Here we provide a perspective on the recent lessons in the 
immunotherapy space and summarize the emerging framework 
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Figure 1. The immuno-oncology framework provides a set of methodological 
improvements for the development of cancer immunotherapies, which are 
tailored to this class of therapies. Each component addresses a relevant piece 
of the drug development process and was evolved out of a community 
consensus approach through the immunotherapy organizations CIC and CIMT. 
The framework is expected to expand with ongoing evolution of the field. 



that promises to enable greater and more reproducible success and 
provide credibility for future development (Fig. 1). 

The Evolving Framework for Immuno-Oncology 

Oncology, the clinical discipline of cancer therapy, has been an 
established medical specialty for several decades. Its hallmarks are 
the science of cancer biology as described by Hanahan and 
Weinberg; 18,19 a recognized clinical development paradigm (based 
on observations with chemotherapy) for investigation of new 
therapies in Phase 1, 2 and 3 clinical trials; defined criteria for 
measuring therapeutic effects such as RECIST (Response 
Evaluation Criteria In Solid Tumors) or WHO (World Health 
Organization) criteria for solid tumors; understood kinetics of 
therapeutic effects; established standards for publication of new 
scientific data; and the availability of effective therapies paired 
with a clear understanding of their use. All this is embedded in a 
well-circumscribed community represented by organizations such 
as the American Society of Clinical Oncology (ASCO) and the 
European Society of Medical Oncology (ESMO). Together, these 
hallmarks create a framework of credibility in which patient 
care, scientific discovery, publication, clinical development and 
regulatory review can take place. 

Despite clear evidence that the whole class of cancer immuno- 
therapies has critical unique features that are different from those 
of the established classical therapeutic approaches in oncology, the 
field did not yet create an appropriate alternative methodological 
framework accommodating these class-specific characteristics. 
Rather, to minimize controversy and gain recognition in 



oncology, investigations of immunotherapies utilized the 
existing development pathway that was based on cytotoxic 
drugs. This ultimately may have contributed to many failures 
in development. 

Between 2004 and today, CIC and CIMT filled this void 
by creating a systematic framework incorporating broad 
community knowledge and providing needed tools for 
successful development of immunotherapies (Table 1). 

Cornerstones of a New Development Paradigm 
for Cancer Immunotherapy 

The process began with the proposal of a clinical develop- 
ment paradigm. In 2004, much knowledge around develop- 
mental problems and potential solutions existed in the field, 
however, there had been little consensus on how to uniformly 
utilize this knowledge and pull together a more comprehens- 
ive paradigm. CIC-CRI and another partner organization, 
the international Society for Biological Therapy of Cancer 
(iSBTc; now the Society for Immunotherapy of Cancer) 
formed a community-wide initiative known as the Cancer 
Vaccine Clinical Trial Working Group (CVCTWG), 
including key stakeholders from academia, the biotechnology 
and pharmaceutical industry and the US FDA to construct 
and recommend a paradigm for development of cancer 
vaccines and related immunotherapies. The proposed 
paradigm recognizes differences between chemotherapy and 
immunotherapy such as: (1) the optimal biologic dose is often 
not the maximum tolerated dose; (2) treatment effect is not pro- 
portionally linked to toxicity; (3) conventional pharmacokinetics 
may not determine dose and schedule; (4) anti-tumor response is 
not the sole predictor of survival; and (5) clinical effects can be 
delayed in time and can occur after tumor volume increase (often 
categorized as progression). The new paradigm breaks down the 
development process into proof-of-principle trials and efficacy 
trials, where efficacy trials are recommended to be randomized 
(Phase 2 and 3 trials). Further, it offers considerations for toxicity 
screening in early trials, concepts for measurement of biologic 
activity, use of immune response assays in clinical trials, dose and 
schedule investigation, decision points in development, trial 
design, improved clinical endpoints, and combination therapy. 
Besides the systematic approach to the developmental science, 
much value of this paradigm lies in the consensus between all 
main constituents involved with cancer immunotherapy develop- 
ment namely academicians, pharmaceutical/biotech industry and 
the US FDA. 5 ' 13 

New Clinical Effects Requiring 
Improved Clinical Endpoints 



Conventional therapies exert their effects by directly targeting 
tumor cells and typically induce measurable impact on tumor 
growth soon after administration or not at all. In contrast, 
therapies targeting the immune system will provoke anti-tumoral 
effects indirectly by first stimulating the immune system and 
second leading to a broader range of response kinetics including 
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Table 1. The framework for immuno-oncology: Solutions for common challenges 



Challenge 


Solution 


Perspective 


Refs. 


Use of chemotherapy principles 


New clinical development paradigm for 


A defined and reproducible path 


5 


for clinical development of 


immunotherapy with key components: 


for adequate development of 




immunotherapy 


(1) development phases for proof-of-principle 


cancer immunotherapies 






and efficacy; (2) toxicity screening, (3) measurement 








of biologic activity, (4) immune response 
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measurement in clinical trials, (5) dose and schedule, 








(6) developmental decision points, (7) trial design, 








(8) clinical endpoints, (9) combination therapy 






Clinical kinetics of 


Adjustment of endpoints to immunotherapy 


More complete detection of efficacy 


9 


immunotherapies not reflected 


biology 






by conventional endpoints 








No recognized system to 


Immunotherapy response criteria derived 


Capture all clinical activity patterns 


10 


measure all patterns of 


from RECIST and WHO: Immune-related 


for a reliable assessment of activity 




immunotherapy clinical activity 


Response Criteria (irRC) 


signals in early trials 




High data variability for 


Harmonization guidelines and quality 


Enable reproducible investigation of 


28-31 


immune monitoring in 


assurance for immune monitoring assays 


immune response as biomarkers in clinical 




multi-center trials 


development. Subsequently, enable clinical 








qualification and investigate surrogacy. 




Inconsistent reporting of 


Reporting framework for scientific publications: 


Transparency of results and 


11, 12 


immune monitoring results 


Minimal Information About T-cell Assays (MIATA) 


comparability across centers and trials 




in scientific publications 








Limited integration and 


Focused scientific exchange between 


Broad access of new and evolving 


www.cancerresearch. 


U 1 i u 1 UU LIU 1 1 Ul Key bLICllLIIIL 


academia, industry and regulators through 


knowledge and processes across 


(JILj/LUMbUl UUIll 


and developmental knowledge 


meetings and workshops 


the community 










www.cimt.eu 


Absence of regulatory 


Broad scientific exchange with participation 


Credible development criteria 


13, 14 


guidance for cancer 


of regulators to support guidance document 


for prospective use 




immunotherapy development 


development 






Additional components 


Based on community need 


Evolution of framework 





Table 1 adapted from reference 4, with permission. 



delayed effects (after increase of existing tumor lesions or 
appearance of new lesions possibly induced by immune infiltrates) 
or stabilization of tumor lesions. 10 The latter patterns appear to 
be more common than the conventional response. They likely 
reflect the interplay between the immune system and the tumor 
described as immunoediting. 20 The described response kinetics 
also affect downstream events such as survival. 

Delayed effects and stabilization of lesions influence the 
standard efficacy endpoints of anti-tumor response and overall 
survival and are observed across different immunotherapies. 6 ' 9 In 
both cases, endpoints need to be adjusted to address the biology. 
For the survival endpoint, Kaplan-Meier curves from randomized 
immunotherapy trials may show a delayed separation after 
months, which directly influences the statistical power to deter- 
mine treatment effects observed over the entire length of the 
curves. 21 Statistical models used in randomized trials with 
conventional therapies, where separation of curves occurs early 
after treatment began, typically assume a constant hazard ratio 
over time (proportional hazards). Alternative statistical models 
tailored to address the delayed separation of curves have to 
consider that all events prior to the separation do not contribute 
to the differentiation between study arms after the separation, 
thus leading to loss of statistical power. Such new statistical 
models need to compensate for this loss of power. They may 



split the hazard ratio into an early and a late component before 
and after the separation of curves. 9 Importantly, the loss of 
power and absence of early effects should be carefully considered 
when designing randomized trials with early interim and 
futility analyses. 

Modified Response Criteria for Immunotherapies 

Standard WHO 22 or RECIST 23 criteria to assess clinical activity of 
anti-cancer agents were defined to capture effects of cytotoxic 
agents using tumor shrinkage as their measure of activity. Due 
to the new biology described above, the response patterns of 
immunotherapy extend beyond those of chemotherapy, and may 
manifest after a period of stable disease or after initial tumor 
burden increase or appearance of new lesions, which may reflect 
infiltration of lymphocytes into the tumor. 10 ' 24 Many investigators 
have noted such patterns but did not systematically describe 
them due to lack of suitable response criteria. 25 ' 26 Principles for 
development of new response criteria were derived from 
community workshops. 5 Subsequent large data sets supporting 
the development of new response criteria were generated as part of 
the ipilimumab (anti-CLTLA-4) development program encom- 
passing 487 advanced melanoma patients. 10 The resulting data 
characterized four patterns of response. (1) immediate response; 
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(2) durable stable disease with possible slow decline in tumor 
burden; (3) response after tumor burden increase (possible 
lymphocyte infiltration); and (4) response in the presence of 
new lesions. The resulting response criteria, termed immune- 
related response criteria (irRC) are generally based on WHO and 
RECIST criteria, describe tumor burden as a continuous variable 
over time, account for new lesions in the overall tumor burden 
and ask for confirmation of progression similar to the established 
confirmation of response at a subsequent time point after first 
detection. Available data suggest that irRC identify patients with 
previously unrecognized benefit as indicated by favorable survival 
outcomes of patients with novel response patterns as compared 
with patients with progressive disease. 10 However, the irRC still 
are undergoing prospective validation. 

Managing Data Variability 
in Immune Biomarker Development 

As immunotherapy targets immune cells and not tumors, the 
monitoring of treatment-induced immune responses defines 
relevant parameters for elucidation of the therapeutic mode of 
action and the description of early biologic effects prior to reaching 
clinical endpoints. Consequently, immunological monitoring using 
reliable and reproducible assays can enhance clinical development by 
providing information on (1) determining whether an immune 
intervention hit the biological target; (2) defining dose and schedule 
for the intervention; (3) measuring synergistic effects for therapeutic 
combinations; (4) defining study populations; (5) measuring 
therapeutic effects as biological activity; or (6) predicting clinical 
outcomes as surrogates for clinical benefit. 27 

Commonly used cellular immune assays to determine the 
function, phenotype and frequency of antigen-specific T cells and 
other immune effectors (e.g., ELISPOT, intracellular cytokine 
staining, and HLA-peptide multimer staining) bear high data 
variability. 11 This variability has contributed to the field's challenge 
to develop biomarkers for the above clinical applications. A possible 
strategy to reduce data variability observed across institutions can 
now be proposed. Immune response assay harmonization, which 
provides an external quality-control mechanism and guidance for 
assay conduct was undertaken by CIC and CIMT in the context 
large international proficiency panel programs. 

As a result of these proficiency panels, in which more than 120 
laboratories from academia, the biotechnology and the pharma- 
ceutical industry from all over the world are participating, assay 
harmonization has been proposed as a solution (4) to manage data 
variability. Assay harmonization can increase assay performance 
within laboratories and decrease variation of results generated 
across institutions 28 " 33 thereby offering a tool to improve data 
reliability for immune monitoring and enhance clinical develop- 
ment of immune therapies at any stage of assay evolution. 8,34 
Harmonization of assay conduct reminds of the successful 
initiatives of ICH-GCP for clinical protocols. 35 The broad usage 
of assay harmonization may bring immune monitoring to the 
forefront of immune biomarker development, support a better 
understanding of therapeutic modes of action and guide decision 
making in clinical development. 36 



Increasing Consistency in Reporting 
of Immune Monitoring Results 

Variability is not only limited to data resulting from immune 
monitoring experiments. In addition, there is wide variability of 
presentation of methods and results in scientific publications. 
Notably, as of today, many publications of T-cell assay experi- 
ments lack information on some or many of the critical variables 
known to impact on assay performance thus not allowing the 
reader to fully understand or reproduce the experiment. A pub- 
lication framework defining a minimum set of critical information 
of assay reports would provide greater transparency to the scientific 
community about what experiment was done under which con- 
ditions and with which results. Based on the concept of Minimum 
Information About Biological and Biomedical Investigations 
(MIBBI), 37 which created such a mechanism over the last decade 
for more than 30 biological assays such as DNA microarrays, 
RNAi experiments or cellular assays, CIC and CIMT started the 
Minimal Information About T-Cell Assays (MIATA) project. 11 
MIATA aims to establish a framework for publication of T cell 
assay results generated in clinical trials. The MIATA proposal is 
based on an extensive community-wide vetting process over 
approximately 2 y incorporating the expertise and concerns of more 
than 120 individuals from all areas of clinical immunology and 
is aiming for broad acceptance. 12 The final version of MIATA is 
currently being prepared and will become available in 2012. 

Integration and Distribution 
of Key Scientific Knowledge 

Knowledge growth is exponential in most scientific disciplines. 
However, filtration of the relevant information to facilitate 
practical progress is not straightforward. To achieve this for the 
cancer immunotherapy space, CIC (www.cancerresearch.org/ 
consortium) and CIMT (www.cimt.eu) have adopted a simple 
and focused process to address challenges of the field in a one-at-a- 
time approach through workshops and annual scientific meetings. 
Both networks are open communities with wide participation 
among key stakeholders. One guiding principle is to foster the 
exchange of scientific information among colleagues active in basic 
science, clinical translation, industrial development and regulatory 
affairs to initiate field-spanning interactions. By bringing together 
the knowledge of different stakeholders from this still fragmented 
field, an integrative platform is steadily developing with synergistic 
effects that can only be reached through collaboration. Another 
dimension of knowledge transfer was reached by the formation of a 
trans-Atlantic collaboration between both associations leading to 
cross-fertilization and an avoidance of redundancy. Continued 
community participation and contribution of knowledge is a 
cornerstone of this process to address further challenges of the field 
and expand the framework for immuno-oncology. 

Regulatory Guidance 

The described science and new concepts for immunotherapy 
development evolved under CIC and CIMT auspices over several 
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years and with the participation of all major stakeholders from 
academia, biotechnology and pharmaceutical industries, and the 
US FDA. In 2007, the FDA hosted a workshop where these 
topics were reviewed. Subsequently, the FDA published a draft 
regulatory guidance on "Clinical Considerations for Therapeutic 
Cancer Vaccines" 13 where many of these topics were included. 
The FDA draft document went through a public consultation 
period and has become available in its final version in late 20 1 1 . 
Recently, the European Medicines Agency (EMA) issued a 
concept paper to stimulate public feedback on a proposed revision 
of the guidance on "evaluation of anticancer medicinal products 
in man." Notably, the concept paper is specifically addressing 
clinical endpoints for biologies and aims to include a section on 
cancer vaccines. 14 As the regulatory landscape is constantly 
evolving, CIMT has formally initiated a working group focusing 
on regulatory research that is screening for new draft guidance 
documents undergoing public consultations. The working group 
collects expert opinions among the network's members and 
integrates all comments to one consolidated response representing 
the expertise of the community. Similarly, the CIC Executive 
Committee offers responses to regulatory guidance documents. 
CIC and CIMT aim for integration of both positions. This 
process enables the community to speak with a more uniform 
voice and makes it easier for officials at FDA and EMA to review 
and assess community positions. 

Anti-CTLA-4 Antibody Development: 
A Clinical Case Study 

The importance of the new immunotherapy paradigm is 
illustrated through the example of anti-CTLA-4 antibody 
development. 4,17 Clinical investigation of anti-CTLA-4 antibodies 
started at the biotechnology company Medarex in 2000 with 
Phase 1 and 2 trials indicating close to 10% response rates as a 
signal of clinical activity in patients with advanced melanoma. 
Interest from big pharma for developing anti-CTLA-4 blocking 
antibodies led to independent licensing deals with Pfizer and 
Bristol-Myers Squibb (BMS) for isoforms of the antibody and two 
parallel development programs in advanced melanoma with 
tremelimumab (Pfizer) and ipilimumab (BMS), respectively. 
Both programs initially used chemotherapy criteria to guide their 
development choices. 4 As per its design, the tremelimumab 
program conducted an early interim analysis with conventional 
futility criteria for survival in its Phase 3 study and could not 
observe a survival improvement. Consequently, the Phase 3 study 
was terminated for futility as per Data Monitoring Committee 
recommendations. 38 Two years later, extended follow-up on the 
study population revealed a separation of survival curves. 39 



Through the interaction of the ipilimumab program with the 
CIC efforts to create a new immunotherapy paradigm, the 
scientific approach for ipilimumab evolved and led to the change 
of the primary endpoint for both of its Phase 3 studies in 
advanced melanoma to overall survival with no early interim 
analyses, which could mislead the survival assessment. 4,9 ' 16,17 The 
final analysis of survival of two Phase 3 studies demonstrated 
improved survival (HR 0.66 and HR 0.72, respectively) and 
supported the approval for patients with pretreated metastatic 
melanoma. Based on the understanding of immunotherapy 
development BMS acquired Medarex in 2009 in a transaction 
valued $2.4 billion and is now developing a pipeline of immuno- 
oncology agents resulting from the acquisition. 40 

The development paths for ipilimumab and tremelimumab and 
their respective results illustrate the importance of the science- 
driven clinical development paradigm for immunotherapies and 
of collaboration across various constituents to direct scientific 
progress. These observations also suggest that the prospective 
application of the new paradigm may help avoid critical pitfalls for 
future immunotherapy programs. 

Conclusions 

Our scientific knowledge of tumor immunology has steadily 
evolved, 1 and many cancer immunotherapy technologies have 
entered clinical trials. 3,6 ' 42 An obvious weak spot for development 
has been the absence of a tailored clinical development paradigm 
for immunotherapies that distinguishes it from the widely used 
chemotherapy paradigm. 

Over the past decade we have started to systematically 
address the unique characteristics of immunotherapeutic agents 
in clinical trials and developed a methodological framework to 
enable reproducible development. 4 This ranges from a defined 
immunotherapy development paradigm, improved clinical end- 
points, harmonization concepts for immune monitoring to 
support immunological biomarker development, and minimal 
information for publication to enhance interpretability and 
reproducibility, as well as regulatory guidance. This new 
framework may provide for reproducible and likely more 
successful development of cancer immunotherapies and lays 
the foundation for the new clinical sub-specialty of immuno- 
oncology (Fig. 1). The framework may evolve with the 
growing field. 
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